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Abstract 

We  define  near-substitutable  systems  as  systems  that  have  overlapping  capabilities,  but  are 
substantially  different  in  some  dimensions.  Competition  between  such  systems  is  examined  in 
the  context  of  the  dominant  “Weapon  System  Franchise”  model  of  competition  for  major  defense 
acquisition  programs  (MDAPs). 

Competition  between  near-substitutes  can  occur  throughout  the  acquisition  cycle.  It  is  most 
commonly  seen  in  pre-Engineering  and  Manufacturing  Development  Analyses  of  Alternatives 
(AoAs)  where  the  cost-effectiveness  of  a  variety  of  concepts  as  well  as  legacy  systems  and 
potential  derivatives  are  compared.  Our  primary  interest  is  in  competition  later  in  the  acquisition 
lifecycle  when  the  near-substitutes  may  already  exist  in  some  fonn.  We  explored  the  potential 
for  competition  between  near-substitutable  systems  through  three  case  studies: 

•  C-17  and  747-400F/Non  Developmental  Airlift  Aircraft  (NDAA), 

•  Joint  Air-to-Surface  Standoff  Missile  and  Standoff  Land  Attack  Missile-Expanded 
Response,  and 

•  KC-X:  KC-767  and  KC-45. 

We  found  that  near-substitutes  can  provide  competitive  pressure  on  incumbent  systems. 
The  KC-X  was  exceptional  in  that  it  was  a  fonnal  direct  competition  between  near-substitutes 
leading  to  the  award  of  a  franchise.  AoAs  or  other  cost-effectiveness  analyses  can  be  pivotal  in 
bringing  attention  to  near-substitute  systems.  However,  AoAs  comparing  alternatives  to  systems 
already  in  production  tend  to  be  ad  hoc  in  nature.  One  way  to  further  encourage  competition 
between  near-substitutes  would  be  through  a  “rolling  cost-effective  analysis”  process  where  the 
original  AoAs  would  be  updated  as  material  changes  become  evident  in  an  ongoing  program  or 
potential  near-substitutes  surface. 

Two-line  summary 

Competition  between  near-substitutes  can  occur  throughout  the  acquisition  cycle.  We 
explored  the  potential  for  this  type  of  competition  through  three  case  studies. 
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1. 


Introduction 


This  paper  examines  competition  among  near-substitutable  systems.  Near-substitutes 
present  an  interesting  case  for  competition;  their  competitive  threat  is  often  manifested  early  in 
the  concept  development  stage  of  the  acquisition  lifecycle,  but  can  also  put  competitive  pressure 
on  an  existing  weapon  system  franchise.  Our  approach  was  to  use  three  case  studies  to  illuminate 
the  issues  associated  with  competition  between  near-substitutable  systems.  The  objective  was  to 
draw  lessons  to  inform  government  actions  and  policies  that  could  encourage  such  competition 
in  the  future. 


2.  Competition  for  a  Weapon  System  Franchise 

We  considered  competition  among  near-substitutes  within  the  context  of  the  “Competition 
for  a  Weapon  System  Franchise”  case,  as  presented  in  Dominy  et  al.  (201 1).  A  franchise  begins 
with  development  of  the  system,  followed  by  serial  production  over  a  period  that  can  continue 
for  as  long  as  20  years.  Typically,  two  (or  very  occasionally  more)  firms  compete  for  an 
Engineering  and  Manufacturing  Development  (EMD)  contract.  The  EMD  process  results  in  a 
detailed  design  of  the  system;  design  and  production  of  the  tooling  and  equipment — and 
sometimes  facilities — needed  to  produce  the  system;  and  building  of  “production  representative” 
units  of  the  system  for  testing.  Successive  annual  lots  are  then  purchased  using  a  series  of 
separately  negotiated  contracts.  Multi-year  contracts  (covering  production  of  three  to  five  annual 
lots)  may  be  used  in  place  of  annual  contracts  once  the  system  has  reached  maturity.  These 
contracts  ordinarily  are  typically  placed  with  the  firm  that  won  the  EMD  contract,  on  a  sole- 
source  basis.  This  is  the  most  common  case;  it  is  typical,  for  example,  of  major  defense 
acquisition  programs  for  aircraft,  ships,  tactical  missiles,  and  combat  vehicles.  Competition 
among  near-substitutes  is  a  variant  on  this  common  case. 


3.  Definition  of  Near-Substitutable  Systems 

The  definition  of  near-substitutable  systems  is  the  following:  systems  that  have  overlapping 
capabilities,  but  are  substantially  different  in  some  dimensions.  It  is  easiest  to  start  with  an 
example  of  what  they  are  not.  To  achieve  a  military  objective,  it  is  sometimes  possible  to  choose 
between  systems  that  have  no  meaningful  overlapping  capabilities.  An  example  would  be  the  use 
of  tactical  jamming  devices  to  penetrate  enemy  airspace,  instead  of  designing  stealth  features 
into  the  aircraft  platform.  Yet  a  third  way  to  achieve  the  same  ends  might  be  the  use  of  long- 
range  standoff  weapons  on  conventional  aircraft  platfonns.  This  mode  of  competition  between 
non-overlapping  alternatives  clearly  falls  outside  of  our  definition. 
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Thus  we  will  limit  the  case  of  near-substitutes  to  be  competitions  among  items  of  the  same 
commodity  class;  e.g.,  aircraft  versus  aircraft,  missile  vs.  missile.  What  then  separates  near¬ 
substitutes  from  perfect  substitutes,  i.e.,  the  dual-sourcing  variant  of  the  weapons  system 
franchise  case?  In  bounding  the  definition  in  this  direction  we  limit  the  near-substitute  case  to 
instances  where  systems  were  not  originally  designed  to  fulfill  the  same  military  requirement. 
Given  this,  a  near-substitute  may  often  be  a  non-developmental  item  that  can  be  modified  or 
repurposed  to  fill  a  military  need. 

This  leads  naturally  to  the  question  of  where  competition  between  near-substitutes  fits 
within  the  overall  acquisition  process.  We  would  expect  this  competition  to  begin  in  the  early 
portions  of  the  acquisition  cycle,  and  continue  at  least  though  the  perfonnance  of  the  initial 
Analysis  of  Alternatives  (AoA).  However,  it  would  be  rare  (although  not  unprecedented)  for 
competition  between  near-substitutes  to  occur  as  a  result  of  a  request  for  proposals  (RFP)  leading 
to  direct  competition  for  a  franchise  or  as  an  alternative  to  a  current  franchise  holder.  Near¬ 
substitutes,  however,  can  provide  competitive  pressure  on  incumbent  or  quasi-incumbent  (heir- 
apparent)  systems  throughout  the  acquisition  cycle. 1  Decision  makers  can  set  up  the  competition 
between  near-substitutes  such  that  the  incumbent  is  threatened  with  the  loss  of  its  franchise. 
AoAs  or  other  cost-effectiveness  analyses  can  prove  pivotal  in  bringing  attention  to  near¬ 
substitute  systems;  the  role  of  cost-effectiveness  analysis  is  an  important  topic  in  the  case 
studies. 


4.  Literature  on  Competition  among  Near-Substitutes 

Although  we  have  found  no  analytic  discussion  specific  to  the  near-substitute  competition 
variant,  it  is  useful  to  relate  its  unique  attributes  to  the  broader  literature.  In  Rogerson’s  (1994) 
survey  article  on  the  economics  of  defense  procurement,  he  interprets  the  subject  as  a 
government  regulatory  problem  with  several  distinguishing  characteristics: 

•  The  importance  of  research  and  development, 

•  Uncertainty, 

•  Economies  of  scale  in  production,  and 

•  The  role  of  government  as  a  sole  purchaser. 

Although  all  of  these  characteristics  have  some  relevance  to  competition,  we  will 
concentrate  on  the  first  and  third  points.  Due  to  the  high  costs  of  carrying  multiple  firms  through 
EMD  and  production,  competition  is  usually  only  feasible  through  the  conceptual  design  and 
prototyping  phases — the  down  select  at  this  point  establishes  a  franchise  for  a  single  winner.  In 


This  is  consistent  with  DoDD  5000.1,  which  states  “Acquisition  managers  shall  take  all  necessary  actions  to 
promote  a  competitive  environment,  including  the  consideration  of  alternative  systems  to  meet  stated  mission 
needs.” 
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our  framework  for  competition  between  near-substitutes,  the  limitations  imposed  by  high 
development  costs  and  loss  of  economies  of  scale  in  production  are  less  relevant:  a  near¬ 
substitute  may  already  exist  in  some  form  and  have  an  ongoing  production  base.  This  is  an 
enonnous  advantage  for  the  near-substitute  as  compared  with  an  item  yet  to  be  developed. 


5.  Case  Studies 

We  chose  three  case  studies  to  help  explore  issues  associated  with  competition  between 
near-substitutes. 

A.  C-17  versus  Commercial  Cargo  Aircraft 

In  the  late  1980s  and  early  1990s,  the  C-17  program  encountered  substantial  difficulties  in 
terms  of  perfonnance  shortfalls,  cost  overruns,  and  schedule  delays.  Because  of  these  difficulties, 
the  Congress  directed  DOD  as  part  of  its  FY  1993-1994  Defense  Authorization  Act  to  conduct  a 
Defense  Acquisition  Board  (DAB)  review  of  the  program;  included  were  an  examination  of  C-17 
requirements  and  affordability  as  well  as  the  results  from  a  new  cost-effectiveness  analysis  (then 
referred  to  as  a  Cost  and  Operational  Effectiveness  Analysis,  or  COEA).  At  the  time,  the  Air 
Force  had  planned  to  buy  120  C-17s,  with  20  already  funded  (U.S.  General  Accounting  Office, 
1994). 

The  COEA  was  performed  by  the  Institute  for  Defense  Analyses  (IDA);  alternatives  to  the 
full  120  C-17  program  included  the  procurement  of  Boeing  747-400F  freighters  (Boeing  had  yet 
to  acquire  McDonnell  Douglas,  the  C-17  prime  contractor  at  the  time).  Important  characteristics 
of  the  C-17  and  747-400F  are  included  in  Table  1. 


Table  1.  Comparison  of  C-17  and  747-400F  Characteristics 


Characteristic 

C-17 

747-400F 

Average  payload  (tons) 

48.3 

73.7 

Surge  utilization  rate  (hrs/day) 

15.2 

12.5 

Block  speed  (knots) 

423 

445 

Million-ton-miles/day  (MTM/D) 

.146 

.191 

Maximum  on  ground  (MOG),a  robust  conditions 

26 

15 

MOG,  constrained  conditions 

16.5 

5.0 

Note:  Data  from  Greer,  W.  L.  et  at,  (1993). 


Maximum  number  of  aircraft  on  ground  simultaneously  in  theater  for  the  Major  Regional  Contingency-East  scenario. 

The  747-400F  has  advantages  in  payload/range  perfonnance  while  the  C-17  has 
substantially  better  Maximum  on  Ground  (MOG)  metrics,  can  deliver  outsized  cargo  (primarily 
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large  armored  vehicles)  and  performs  military-specific  missions  such  as  air-drop  and  combat 
delivery.  The  747-400F  clearly  fits  into  our  definition  of  a  near-substitute  relative  to  the  C-17 
(the  incumbent  in  this  case). 

The  COEA  posited  alternative  fleets  with  the  same  MTM/D  as  the  planned  fleet  with  120 
C-17s.  While  MTM/D  is  a  static  measure,  the  effectiveness  modeling  took  into  account  dynamic 
effects,  including  the  impact  of  limited  airfield  space  in  theater.  The  overall  results  were  that  a 
mixed  fleet  of  C-17s  and  747-400Fs  (along  with  other  aircraft  in  the  planned  force)  had 
approximately  equal  cost-effectiveness  when  compared  with  the  case  with  120  C-17s.  The 
COEA  found  significant  synergies  between  the  747-400Fs  and  aircraft  carrying  outsize  cargo 
(C-17s  and  C-5s);  the  additional  oversize  and  bulk  carrying  capacity  of  the  747-400Fs  freed  up 
space  in  the  aircraft  capable  of  carrying  outsized  cargo. 

The  December  1993  DAB  review  resulted  in  several  actions.  An  RFP  for  a  non¬ 
development  airlift  aircraft  (NDAA)  was  released;  the  NDAA  could  be  a  new  commercial 
freighter  or  refurbished/modified  used  aircraft.  Boeing  was  the  only  respondent,  with  its  C-33 
(the  military  designation  for  the  747-400F).  Parallel  actions  for  the  C-17  included  directing 
management  and  manufacturing  process  improvements,  as  well  as  the  approval  of  procurement 
through  the  fortieth  aircraft.  The  C-17  was  put  on  probation  for  two  years,  with  the  fate  of  the 
remaining  80  aircraft  to  be  determined  at  the  end  of  1995.  The  C-33  provided  DOD  with  a  clear 
alternative  if  C-17  program  improvements  were  not  forthcoming,  while  placing  competitive 
pressure  on  McDonnell  Douglas. 

By  the  end  of  1995,  the  C-17  program  had  satisfied  the  DAB  with  its  progress  and  an  80- 
aircraft  multi-year  procurement  (MYP)  was  approved.  The  NDAA  program  was  shelved.  The 
general  view  was  that  the  two-year  probationary  period  was  a  success  (Bolkcom,  2007). 
Comparisons  of  actual  C-17  procurement  cost  with  those  presented  in  the  1993  COEA  show  the 
actual  cost  for  the  final  100  of  the  originally  planned  120  aircraft  substantially  below  that 
estimated  by  IDA,  and  slightly  below  the  lower  Air  Force  estimate  ($21.8  billion  versus  $26.3 
billion  and  $22.9  billion,  respectively,  in  FY  1993  dollars  for  aircraft  21-120). 

B.  Joint  Air-to-Surface  Standoff  Missile  and  Standoff  Land  Attack  Missile-Expanded 

Response 

In  1994,  the  Tri-Service  Standoff  Attack  Missile  (TSSAM)  was  cancelled  because  of  cost 
overruns.  However,  the  services’  requirement  for  an  air-launched  standoff  precision  weapon  to 
attack  well-defended  high-value  targets  did  not  go  away.  The  Joint  Air-to-Surface  Standoff 
Missile  (JASSM)  program  was  initiated  (Milestone  0)  in  September  1995  as  a  joint  Navy/Air 
Force  program;  the  approach  was  to  take  the  lessons  learned  from  the  TSSAM  program  and 
apply  acquisition  refonn  initiatives  in  order  to  produce  an  affordable  missile  with  capabilities 
similar  to  those  of  the  TSSAM. 
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The  Navy’s  Standoff  Land  Attack  Missile-Expanded  Response  (SLAM-ER)  was  a  major 
modification  of  the  SLAM  (which  in  turn  was  an  adaptation  of  the  Harpoon  anti-ship  missile), 
intended  to  give  the  Navy  a  standoff  capability  against  land  as  well  as  ship  targets.  Like  the 
Harpoon  and  SLAM,  the  SLAM-ER’ s  prime  contractor  was  McDonnell  Douglas  (later  bought 
by  Boeing).  The  SLAM-ER  had  approximately  a  two-year  head  start  on  JASSM  with  an  EMD 
contract  awarded  in  March  1995.  The  SLAM-ER  had  a  new  airframe/wing  design  to  increase 
range,  a  warhead  with  increased  lethality,  as  well  as  avionics/software/mission  planning 
upgrades  to  improve  accuracy  and  make  employment  easier.  As  an  upgrade  to  a  small  number  of 
existing  missiles,  the  SLAM-ER  was  not  subject  to  the  standard  acquisition  milestone  process. 

The  JASSM  and  SLAM-ER  share  many  capabilities,  but  with  some  important  differences. 
Characteristics  of  the  two  missiles  are  included  in  Table  2. 


Table  2.  Comparison  of  JASSM  and  SLAM-ER  Characteristics 


Characteristic 

JASSM 

SLAM-ER 

Length  (ft) 

14.0 

14.3 

Diameter  (inches) 

18.0 

12.5 

Total  weight  (lbs) 

2,250 

1,388 

Warhead  weight  (lbs) 

990 

488 

Maximum  range  (nmi) 

180-200 

150 

Note:  Data  from  Forecast  International. 


The  JASSM  is  heavier,  has  longer  range,  and  carries  a  larger  penetrating  warhead. 
Guidance  systems  are  similar,  with  Global  Position  System  (GPS)  bringing  the  missiles  close  to 
their  targets  while  imaging  infrared  sensors  are  used  in  the  tenninal  phase.  Both  missiles  use  the 
same  Williams  turbojet  engine.  A  distinguishing  attribute  of  the  SLAM-ER  is  its  two-way  data- 
link  with  man-in-the-loop  functionality.  This  gives  the  SLAM-ER  the  capability  to  attack 
moving  targets  such  as  ships,  as  well  as  providing  additional  tactical  flexibility.  The  JASSM’s 
“fire  and  forget”  capability  is  meant  only  for  stationary  targets;  a  similar  capability  was  included 
in  the  SLAM-ER  as  a  retrofit  in  the  FY  1999  production  lot.  The  JASSM  is  also  distinguished  by 
its  stealth  capabilities. 

The  JASSM  program  was  required  to  complete  an  AoA-like  activity  prior  to  Milestone  I 
and  the  start  of  the  Program  Definition  and  Risk  Reduction  (PDRR)  phase.  COEA  I  compared 
potential  JASSM  capabilities  and  associated  technologies  to  those  achievable  through 
modification  of  existing  systems.  It  was  not  clear  from  available  documentation  whether  SLAM- 
ER  was  included  in  COEA  I.  COEA  I  found  JSSAM  the  preferred  alternative.  Milestone  I 
occurred  in  June  1996,  with  Lockheed  Martin  and  McDonnell  Douglas  chosen  to  design  and 
build  prototype  missiles.  Prior  to  Milestone  II  and  the  beginning  of  EMD,  an  updated  COEA 
(COEA  II)  was  required,  in  which  the  two  candidate  systems  from  the  PDRR  phase  were 
compared  directly  to  the  SLAM-ER  ( JASSM  SAMP,  1997).  COEA  II  also  found  the  JASSM  to 
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be  the  preferred  system.  Milestone  II  occurred  in  November  1998,  with  Lockheed  Martin  chosen 
as  the  prime  contractor. 

JASSM  acquisition  initiatives  included  adoption  of  commercial  practices,  minimization  of 
military  specifications  and  data  reporting,  and  cost  as  an  independent  variable.  The  general 
approach  was  to  give  the  contractors  maximum  flexibility  in  making  trade-offs  within  the 
constraints  of  high-level  key  perfonnance  parameters  (KPPs)  and  a  unit  cost  goal  of  $400,000- 
$700,000  in  FY  1995  dollars.  Another  aspect  of  the  acquisition  strategy  was  the  use  of  price- 
based  acquisition  (PBA).  This  meant  the  inclusion  of  fixed  price  options  for  the  first  five 
production  lots  (accounting  for  1,146  of  the  2,400  Milestone  II  requirements)  as  part  of  the  EMD 
contract  and  the  elimination  of  cost  reporting  for  those  lots.  This  resulted  in  concessionary  prices 
on  the  part  of  Lockheed  Martin  for  those  lots  along  with  a  high  risk  that  subsequent  lots  would 
increase  in  price  and  with  the  government  left  with  limited  infonnation  for  use  in  negotiation  and 
program  planning.  This  problem  opened  up  another  opportunity  for  contrasting  JASSM  and 
SLAM-ER. 

As  a  fallout  of  the  PBA  strategy,  IDA  performed  an  “independent  market  survey”  analysis 
in  support  of  the  JASSM’s  2004  Milestone  III  full  rate  production  decision  (Woolsey  et  ah, 
2004).  A  unique  aspect  of  this  was  the  use  of  effectiveness  analysis  to  help  detennine  fair  prices 
for  the  JASSM  in  relation  to  the  prices  and  capabilities  of  other  standoff  missiles,  including  the 
SLAM-ER.  The  campaign  model  used  did  not  force  the  one-for-one  substitution  of  the 
competitive  missiles  for  JASSMs;  instead,  platform/weapon/target  assignments  were  detennined 
by  an  optimization  model  where  Blue  (friendly)  losses  were  minimized.  From  this  a  utility 
measure  was  specified,  Uk=QjassJQk,  where  64  was  the  utility  for  the  4th  competitive  missile, 
Qjassm  was  the  quantity  of  JASSMs  planned  at  Milestone  III,2  and  Qk  was  the  quantity  of  the  4th 
competitive  missile  required  for  Blue  attrition  and  campaign  length  to  equal  those  for  the  JASSM 
quantities.  The  utility  measure  provided  a  basis  for  comparing  near-substitutable  systems.  Target 
prices  for  the  JASSM  in  relation  to  the  competitors  were  then  defined  as  Pjassm  =  Pk/Uk',  for  the 

JASSM  to  be  a  “good  deal”  relative  to  competitors,  its  purchase  price  would  need  to  be  equal  to 
or  below  Pjassm •  In  practice  PJ 64  varied  over  a  range,  depending  on  effectiveness  modeling 

assumptions  and  pricing  ground  rules  for  the  competitive  missiles.  In  the  analyses,  the  missiles 
resulting  in  the  lowest  Pk/Uk  metrics  were  the  SLAM-ER  and  the  Stonn  Shadow,  a  France/UK 
joint  venture. 

It  was  never  likely  that  the  Air  Force  would  buy  the  SLAM-ER  ( Navy  News  &  Undersea 

-5 

Technology,  1999).  However,  there  was  a  possibility  that  the  Navy  would  procure  fewer 
SLAM-ERs  in  favor  of  JASSM.  It  should  be  noted  that  although  the  Navy  was  a  participant  in 


At  this  point,  the  planned  quantity  had  increased  to  4,250. 

The  Navy  had  offered  40-50  SLAM-ERs  to  the  Air  Force  for  use  on  B-52s  against  Yugoslavia,  with  the  Air 
Force  refusing  the  offer;  reports  indicated  that  the  Air  Force  viewed  the  SLAM-ER  as  a  threat  to  JASSM 
procurement. 
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the  JASSM  program,  its  contributions  to  development  were  minimal  and  no  procurement  was 
funded  (although  quantities  up  to  around  700  were  considered).  In  the  end,  the  Navy  did  not 
significantly  change  their  SLAM-ER  inventory  goal  (which  varied  between  400  and  600), 
although  they  did  buy  out  their  requirement  substantially  faster  than  originally  planned.  The 
Navy  formally  pulled  out  of  the  JASSM  program  in  February  2005;  they  were  satisfied  with  the 
SLAM-ER  for  their  standoff  missile  requirements  (Fein,  2005). 

The  JASSM  was  subject  to  a  Nunn-McCurdy  breach  in  April  2007,  primarily  because  of 
increases  in  procurement  unit  costs.  The  program  was  not  recertified  until  one  year  later;  the 
delay  was  mainly  because  of  concerns  regarding  reliability.  During  this  period,  the  Air  Force 
released  a  Request  for  Infonnation  for  alternative  missiles.  We  do  not  know  from  available 
documentation  whether  Boeing  responded  with  the  SLAM-ER  (Putrich,  2008). 

The  SLAM-ER  and  JASSM  exerted  competitive  pressure  on  one  another  throughout  their 
acquisition  cycles.  However,  following  Milestone  II,  decision  makers  never  set  up  a  “do  or  die” 
moment  for  either  system,  as  was  the  case  for  the  C-17/NDAA.  It  is  not  clear  whether  program 
outcomes  were  materially  affected.  The  JASSM  program’s  ambitious  unit  price  goals  may  have 
been  partially  prompted  by  competitive  pressure  from  the  SLAM-ER;  the  lower  JASSM  price 
estimates  were  an  important  advantage  in  the  Milestone  II  AoA  (JASSM  AoA,  1998).  However, 
in  the  course  of  program  execution,  JASSM  average  procurement  unit  prices  almost  doubled 
($720K  versus  $400K  FY  1995  dollars),  while  SLAM-ER  prices  changed  little.  In  terms  of 
missile  capabilities,  the  upgrade  paths  of  the  missiles  showed  convergence  in  some  objective 
capabilities.  Already  mentioned  is  the  upgrade  of  SLAM-ER  with  automatic  target  recognition; 
there  are  plans  for  JASSM  to  add  a  two-way  data  link  and  maritime  attack  capabilities.  JASSM 
and  SLAM-ER  compete  with  one  another  for  foreign  sales,  although  the  additional  capabilities 
of  JASSM  mean  that  it  is  available  to  fewer  nations.  A  notable  direct  competition  was  to  equip 
Australia’s  F/A-18s,  where  the  JASSM  was  chosen  over  the  SLAM-ER  (Australian  Defence 
Magazine,  2007). 

C.  The  KC-X  Competition 

The  KC-X  tanker  aircraft  program,  an  important  instance  in  which  near-substitutable 
systems  were  part  of  a  formal  direct  competition,  was  meant  to  replace  the  aging  KC-135  fleet  of 
air-refueling  tankers.  This  program  also  has  a  unique  back-story.  The  Air  Force  originally 
proposed  to  lease  Boeing  KC-767  aircraft  for  use  as  tankers  under  a  commercial  operating  lease. 
Due  to  shortcomings  in  that  program,  the  DOD  Inspector  General  (Department  of  Defense  Office 
of  the  Inspector  General.  2004)  recommended  that  a  new  acquisition  program  be  implemented 
that  complied  with  all  requirements  for  a  major  acquisition  program,  including  the  performance 
of  an  AoA. 

The  AoA  was  performed  by  RAND,  which  found  that  new  medium-to-large-sized  wide- 
body  commercial  aircraft-based  tankers  (767-747)  were  the  best  solution  for  KC-135 
recapitalization.  Although  cost-effectiveness  analyses  were  perfonned  on  individual  aircraft 
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models  within  this  category,  RAND  did  not  think  that  the  cost  analyses  had  sufficient  fidelity  to 
detennine  a  specific  solution.  The  price  of  the  “green”  aircraft  (the  commercial  aircraft  prior  to 
modification  to  tanker  configuration)  was  cited  as  an  important  source  of  uncertainty.  Given  this, 
RAND  recommended  an  open  competition  to  detennine  the  best  alternative  (Kennedy,  2006). 

The  Air  Force  released  an  RFP  in  January  2007  for  EMD  and  initial  procurement.  The 
offerors  were  Boeing,  with  the  KC-767,  and  Northrop  Grumman,  with  the  KC-45  (an  evolution 
of  the  EADS/Airbus  A330  Multi-role  Tanker  Transport  [or  MRTT])).  Both  competitors  had  sold 
precursor  aircraft  to  foreign  customers  in  limited  quantities,  but  both  competitors  would  need  to 
perfonn  additional  development  to  meet  U.S.  Air  Force  requirements.  Table  3  presents 
characteristics  for  the  KC-X  precursor  aircraft  together  with  the  KC-135. 


Table  3.  Comparison  of  KC-135,  KC-767,  and  A330  MRTT  Characteristics 


Characteristic 

KC-135R 

KC-767 

A330  MRTT 

Length  (ft) 

136 

159 

193 

Wing  Span  (ft) 

130 

156 

198 

Maximum  Fuel  Weight  (Klbs) 

200 

202 

245 

Max.  Gross  Take-off  Wgt.  (Klbs) 

323 

395 

514 

Note-.  Data  from  U.S.  Air  Force,  Boeing,  and  EADS  North  America. 


The  KC-45  is  a  substantially  larger  aircraft  than  the  KC-767.  The  metric  in  the  RFP  most 
relevant  to  size  was  fuel  offload/range  performance;  the  offerors  were  expected  to  meet  or 
exceed  KC-135  perfonnance — the  so-called  KC-135  KPP.  However,  the  RFP  did  not  indicate 
that  any  consideration  would  be  given  to  by  how  much  it  was  exceeded. 

Another  RFP  metric  relevant  to  size  was  the  integrated  fleet  aerial  refueling  assessment 
(1FARA)  factor.  The  1FARA  factor  was  derived  using  a  modeling  and  simulation  tool  applied  to 
various  scenarios;  the  factor  is  the  inverse  of  the  quantity  of  an  offeror’s  aircraft  that  would  be 
required  in  order  to  perform  the  scenarios  divided  by  the  number  of  KC-135R  aircraft  needed. 
This  is  similar  to  the  type  of  analysis  used  in  the  RAND  AoA.  The  IFARA  metric  should  be 
positively  correlated  to  maximum  fuel  weight,  but  would  also  take  into  account  other  constraints 
on  employing  tankers,  many  of  which  would  advantage  a  smaller  aircraft.  The  IFARA  factor  was 
1.90  for  the  KC-45  and  1.72  for  the  KC-767.  Although  the  IFARA  factor  could  be  used  as  a 
discriminator,  its  weighting  was  low  relative  to  other  categories. 

The  Air  Force  selection  board  chose  the  Northrop  Grumman/EADS  KC-45.  Boeing 
protested  the  selection  and  the  protest  was  sustained  on  a  variety  of  counts  (General 
Accountability  Office,  2008).  The  most  important  was  the  use  of  perfonnance  above  the  KC-135 
KPP  as  a  discriminator  in  violation  of  the  RFP  instructions. 

The  problems  with  the  KC-X  program  demonstrate  the  complications  associated  with  a 
direct  competition  between  near-substitutes.  In  the  course  of  direct  competition,  the  weighting  of 
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discriminators  that  flow  from  divergent  attributes  will  be  critical.  The  use  of  modeling  and 
simulation  tools  that  can  aggregate  over  different  attributes  to  fonn  discriminators  in  a  single 
dimension  is  a  possible  response.  Although  the  IFARA  factor  was  consistent  with  this  approach, 
it  was  given  minimal  weight  in  the  original  competition.  However,  for  the  selection  criteria 
included  in  the  revised  KC-X  RFP  (Department  of  the  Air  Force,  Air  Force  Materiel  Command, 
2010)  the  IFARA  factor  was  more  central,  as  it  was  included  as  an  adjustment  factor  on  the 
offerors’  pricing  data.  Boeing  was  declared  the  winner  of  the  second  competition.  Although  the 
ultimate  success  of  the  KC-X  program  has  yet  to  be  determined,  it  is  likely  that  the  prices 
originally  established  as  part  of  the  sole-source  lease  will  be  improved  upon.4 


6.  Conclusions 

In  general,  the  purpose  of  competition  between  near-substitutes  has  not  been  to  gain  lower 
prices,  but  has  focused  on  capability  and  quality  issues.  Direct  competition  in  which  the  offered 
price  is  the  key  metric  has  been  the  exception.  Almost  by  definition,  the  up-front  investment  for 
competition  between  near-substitutes  is  relatively  small  as  the  systems/platforms  will  likely 
already  exist  in  some  form  (this  was  the  case  for  all  of  our  case  studies).  The  primary  benefit  is 
to  provide  decision  makers  with  multiple  ways  to  fill  capability  gaps.  The  best  way  (and  perhaps 
the  only  valid  way)  to  detennine  the  relative  value  of  near-substitutes  is  by  employing  cost- 
effectiveness  analyses  that  portray  the  different  interactions  of  the  near-substitutes  with 
complementary  military  force  structure  and  physical  infrastructure.  This  clearly  is  a  difficult 
proposition  in  the  case  of  direct  competition,  although  the  second  KC-X  RFP  attempted  to 
implement  this. 

In  terms  of  the  industrial  base,  near-substitutes  provide  the  opportunity  to  expand  the  base 
of  suppliers.  This  can  be  seen  in  the  example  of  Boeing  commercial  in  the 
C-17/NDAA  case  and  EADS/Airbus  in  the  KC-X  case.  It  is  interesting  to  note  that  the 
acquisition  of  McDonnell  Douglas  by  Boeing  would  now  hamper  the  participation  of  Boeing 
commercial  as  an  alternative  supplier  of  airlift  aircraft,  given  the  C-17’s  incumbent  status. 


7.  Policy  Levers 

How  might  the  consideration  of  near-substitute  systems  to  meet  military  requirements  be 
encouraged?  The  requirement  for  an  AoA  is  certainly  a  good  starting  place.  However,  in  current 
acquisition  policy,  an  AoA  or  a  similar  cost-effectiveness  analysis  is  not  required  after  Milestone 


Unit  price  data  associated  with  Boeing’s  winning  bid  have  not  been  released. 
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B  (formerly  Milestone  II).  In  the  C-17/NDAA  example,  a  post-Milestone  B  cost-effectiveness 
analysis  was  undertaken  because  of  pressures  from  the  Congress  and  DOD  leadership.  In  the 
JASSM/SLAM-ER  case  no  follow-on  comparative  cost-effectiveness  analysis  was  performed 
even  though  the  pre-Milestone  II  COEA  reflected  relative  pricing  assumptions  that  changed 
substantially  as  the  program  progressed.  One  way  to  encourage  competition  would  be  through  a 
“rolling  cost-effective  analysis”  process,  where  the  original  AoAs  would  be  updated  as  material 
changes  become  evident  in  the  program  or  potential  near-substitutes.  As  a  program  office  itself 
may  be  in  a  de  facto  advocacy  position,  any  action  encouraging  competition  from  a  near- 
substitutable  system  may  need  to  be  initiated  by  an  outside  authority. 
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Near  Substitutes 


Systems  that  have  overlapping  capabilities,  but  are 
substantially  different  in  some  dimensions 

■  Limited  to  items  of  the  same  commodity  class 

■  E.g.,  long-range  artillery  and  strike  aircraft  may  have 
overlapping  target  sets  but  are  not  near-substitutes 

■  Systems  not  originally  designed  to  fulfill  the  same 
military  requirement 

E.g.,  F-22  and  F-23  were  not  near-substitutes 

■  Usually  a  non-developmental  item  that  can  be 
modified  or  repurposed  to  fill  a  specific  military  need 


IDA 


MDAP  “Franchise”  Context 


■  What  is  a  Major  Defense  Acquisition  Program  (MDAP)  franchise? 

■  Firms  compete  with  technology  development  projects  followed  by  a  program 
proposal  to  fulfill  a  defined  military  requirement 

■  Winner  of  the  competition  is  paid  to  develop  the  system  for  production 

■  Serial  fixed-price  procurement  contracts  for  the  winner 

■  What  is  the  value  of  an  MDAP  franchise  to  a  contractor? 

■  Profitable  monopoly  -  fee  allowing  for  economic  rents  with  little  risk  of 
competition 

■  It  is  difficult  in  the  short  run  to  compete  serial  production  (dual  source)  because 
of  specific  investments,  system  complexity,  and  knowledge  transition  costs 

■  “Prize”  of  economic  rents  seen  as  encouraging  innovation 

■  How  do  near-substitutes  fit  in? 

■  Competitors  in  an  Analysis  of  Alternatives  (AoA)  prior  to  a  franchise 
competition 

■  A  competitor  for  a  new  franchise 

■  Potential  threat  to  an  existing  franchise 


1 1  September  2012 
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Near-Substitutes  and  Competition 


■  Nature  of  competition 

■  Generally  not  head-to-head  competition  with  competing  proposals  in 
response  to  a  single  RFP;  more  likely  less  formal  competitive  pressure 

■  Usually  occurs  early  in  the  acquisition  process;  near-substitutes  often 
are  compared  as  a  part  of  AoAs 

■  Other  instances  of  competitive  pressure 

■  Important  attributes 

■  Generally  less  investment  required  than  for  dual  source  competition 

■  Already  existing  production  base  may  provide  for  economies  of  scale 

■  Can  bring  new  players  into  the  industrial  base 

■  Cost-effectiveness  analysis  key  in  comparing  near-substitutes 

■  Analysis  useful  in  determining  the  viability  of  near-substitutable  systems 

■  Examine  trade-offs  between  divergent  attributes  through  effectiveness 
analysis 


1 1  September  2012 
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Case  Studies 


■  Motivation  for  case  studies 

■  Competition  between  near-substitutes  has  no  fixed  definition  in 
acquisition  regulations  or  statute 

■  Historical  examples  can  help  illuminate  the  role  near-substitutes 
can  play  in  increasing  competition 

■  Lessons  learned  may  be  extracted  from  past  experience 

■  Themes  in  case  studies 

■  How  did  competition  come  about  and  what  was  the  nature  of 
that  competition? 

■  What  attributes  did  the  near-substitutes  share  and  how  were 
they  different? 

■  What  was  the  role  of  cost-effectiveness  analysis  and  the  AoA 
process? 


1 1  September  2012 
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C-17  versus  Commercial  Cargo  Aircraft 


■  In  the  late  1 980s/early  1 990s,  the  C-1 7  program  encountered 
substantial  difficulties 

■  Performance  shortfalls,  cost  overruns,  and  schedule  delays 

■  In  FY  93,  the  Congress  directed  DoD  to  conduct  a  Defense 
Acquisition  Board  (DAB)  review  of  the  program 

■  The  C-17  was  in  the  early  production  phase  of  a  planned  1 20-unit  buy 

■  Review  would  cover  requirements  and  affordability 

■  New  cost  and  operational  effectiveness  analysis  (COEA)  specified 

■  COEA  showed  procuring  commercial  freighters  (747-400Fs)  was  a 
viable  alternative  to  a  full  C-1 7  buy 

■  December  1993  DAB 

■  C-17  put  on  a  two-year  “probation” 

■  OSD  initiated  a  parallel  acquisition  of  non-developmental  airlift  aircraft 
(NDAA)  open  to  new  or  used  freighters/transports 


1 1  September  2012 
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C-17  and  747-400F  Attributes 


Characteristic 

C-17 

747-400F 

Average  payload  (tons) 

48.3 

73.7 

Surge  utilization  rate  (hours/day) 

15.2 

12.5 

Block  speed  (knots) 

423 

445 

Million-ton-miles/day  (MTM/D) 

.146 

.191 

Maximum  on  ground  (MOG),a  robust  conditions 

26 

15 

MOG,  constrained  conditions 

16.5 

5.0 

Note:  Data  from  Greer,  W.  L.  et  al.,  1993. 

a  Maximum  number  of  aircraft  on  ground  simultaneously  in  theater  for  the  Major  Regional  Contingency-East  scenario. 


■  Both  the  C-1 7  and  747-400F  could  carry  bulk  and  oversize  cargo 

■  Only  the  C-1 7  could  carry  outsize  cargo  and  perform  military- 
specific  missions  (e.g.,  airdrop,  combat  delivery) 

■  The  747-400F  had  greater  payload  but  was  more  subject  to  airfield 
bottlenecks  than  the  C-1 7  (MOG  metric) 

■  The  COEA  found  synergies  between  the  747-400F  and  other 
aircraft;  747-400  bulk/oversize  capacity  freed  up  space  for  outsize 
cargo  in  the  C-5  and  reduced  C-17  fleets 


1 1  September  2012 


7 


IDA 


C-17  and  NDAA  Outcomes 


■  1993  DAB  Fallout 

■  C-17  management  and  manufacturing  process  improvements 

■  Boeing  was  the  only  respondent  to  the  NDAA  RFP  with  the 
747-400F 

■  Late  1 995  OSD  actions 

■  The  C-1 7  program  had  satisfied  the  DAB  with  its  progress 

■  An  80-aircraft  multi-year  procurement  (MYP)  was  approved 

■  The  NDAA  program  was  shelved 

■  Observations 

■  General  view  was  that  the  two-year  probationary  period  was  a 
success 

■  Program  cost  outcomes  going  forward  were  favorable 

■  Additional  aircraft  were  procured  beyond  the  planned  120 


Competitive  pressure  contributed  to  positive  outcomes 
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Joint  Air-to-Surface  Standoff  Missile; 
Standoff  Land  Attack  Missile-Expanded  Response 


■  Air-to-surface  stand-off  cruise  missiles 

■  The  Joint  Air-to-Surface  Standoff  Missile  (JASSM)  program  was 
initiated  as  a  joint  Navy/Air  Force  program 

■  MS  0:  September  1995 

■  MSI:  June  1996;  flying  prototypes  from  two  contractors 

■  MS  II:  November  1998;  down-select  to  a  single  contractor 

■  Navy  Standoff  Land  Attack  Missile-Expanded  Response  (SLAM-ER) 
-  evolution  of  the  Harpoon  anti-ship  missile 

■  EMD  contract  awarded  in  March  1995 

■  Modification  of  SLAM  which  was  based  on  the  Harpoon;  sole-source 

■  AoA  activity  for  JASSM 

■  COEA  1 :  prior  to  MS  1  -  comparison  of  different  concepts 

■  COEA  II:  prior  to  MS  II  -  comparison  of  two  JASSM  competitors  with  SLAM-ER 

■  No  formal  AoA  after  MS  II  despite  difficulties  in  the  program 

■  An  FFRDC  performed  an  “independent  market  survey”  in  support  of  the  2004 
MS  III  decision:  comparative  effectiveness  analysis  with  SLAM-ER  and  others 
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JASSM  and  SLAM-ER  Attributes 


Characteristic 

JASSM 

SLAM-ER 

Length  (ft) 

14.0 

14.3 

Diameter  (inches) 

18.0 

12.5 

Total  weight  (lbs) 

2,250 

1,388 

Warhead  weight  (lbs) 

990 

488 

Maximum  range  (nmi) 

180-200 

150 

Note :  Data  from  Forecast  International. 


■  Similar  GPS  midcourse/IR  terminal  guidance;  both  missiles  use  the 
same  Williams  turbojet  engine 

■  JASSM  has  a  larger  penetrating  warhead  and  stealth  capabilities 

■  SLAM-ER  has  a  two-way  data  link  with  man-in-the  loop  capability; 
can  attack  some  mobile  targets 

■  JASSM  can  only  attack  fixed  targets  -  “fire-and-forget”  automatic 
target  recognition  capability 

■  JASSM  and  SLAM-ER  are  competitors  for  international  sales 
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JASSM  and  SLAM-ER  Outcomes 


■  JASSM 

■  Substantial  procurement  cost  growth;  $720K  versus  $400K  fy  95  dollars 
(Nunn-McCurdy  breach) 

■  The  Navy  dropped  out  of  the  program  -  no  procurement 

■  Upgrade  path  incorporated  some  SLAM-ER  capabilities 

■  SLAM-ER 

■  Little  change  in  planned  costs  or  quantities,  although  quantities 
were  bought  out  more  quickly 

■  The  Air  Force  was  not  likely  to  buy  SLAM-ERs 

■  Upgrade  path  incorporated  some  JASSM  capabilities 

■  Observations 

■  JASSM  advantage  over  SLAM-ER  in  COEA  II  was  due  to  more 
capability  at  a  similar  price  -  prices,  however,  diverged 

■  No  “second  look”  AoA  after  this  became  apparent 

Some  competitive  pressure  -  Navy  could  have  bought 

JASSM  and  fewer  SLAM-ERs 


IDA 


The  KC-X  Competition 


■  Air  refueling  tankers  to  recapitalize  the  KC-1 35  fleet 

■  Northrop  Grumman/EADS:  KC-45  based  on  A330  Multi-role  Tanker  Transport 
(MRTT) 

■  Boeing:  KC-767  tanker-transport 

■  A330  MRTT  and  KC-767  had  prior  sales  to  international  customers 

■  The  Air  Force  originally  proposed  to  lease  Boeing  KC-767s 

■  Outside  of  normal  acquisition  process  -  no  AoA  or  competition 

■  Shelved  due  to  program  shortcomings  and  irregularities 

■  DoD  Inspector  General  recommended  a  new  acquisition  program  following 
standard  procedures,  including  an  AoA 

■  The  AoA  compared  the  current  KC-1 35  fleet  with  alternatives 

■  New  and  used  airliners,  existing  and  new-development  military  aircraft 

■  Found  new  medium-to-large-sized  wide-body  commercial  aircraft-based  tankers 
(767-747)  were  the  best  solution 

■  Recommended  open  competition 

Exceptional  case  where  near-substitutes  were  in  a  formal 
direct  competition  with  an  RFP  and  down-select 
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!QA  KC-135,  KC-767,  and  A330  MRTT  Attributes 


Characteristic 

KC-135R 

KC-767 

A330  MRTT 

Length  (ft) 

136 

159 

193 

Wing  Span  (ft) 

130 

156 

198 

Maximum  Fuel  Weight  (Klbs) 

200 

202 

245 

Max.  Gross  Take-off  Weight  (Klbs) 

323 

395 

514 

Integrated  fleet  aerial  refueling  assessment 
(IFARA)  factor 

1.00 

1.72 

1.90 

Note :  Data  from  U.S.  Air  Force,  Boeing,  EADS  North  America,  and  GAO. 


■  Large  difference  in  aircraft  size 

■  Maximum  fuel  weight  is  a  central  metric  in  determining  tanker  effectiveness 

■  Constraints  on  employing  tankers  could  advantage  a  smaller  aircraft 

■  Relative  effectiveness  captured  by  Integrated  Fleet  Aerial  Refueling 
Assessment  (IFARA)  factor 

■  Specified  in  RFP 

■  Derived  using  a  modeling  and  simulation  tool  applied  to  various  scenarios 

■  Inverse  of  quantity  of  competitors’  aircraft  divided  by  KC-1 35R  quantities 
required  to  perform  scenarios 

■  Some  additional  development  to  meet  U.S.  Air  Force  requirements 
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KC-X  Outcomes 


■  January  2007  RFP  for  EMD  and  initial  procurement 

■  Offerors  to  meet  or  exceed  KC-1 35  performance  (KC-1 35  KPP) 

■  Did  not  indicate  that  any  consideration  would  be  given  to  by  how  much  it  was 
exceeded 

■  IFARA  factor  was  only  a  second-order  discriminator  with  low  weighting 

■  KC-45  selected  -  however,  Boeing  protest  was  sustained 

■  Use  of  performance  above  the  KC-1 35  KPP  as  a  decisive  factor  in  violation  of 
the  RFP  instructions 

■  February  2010  Revised  RFP 

■  IFARA  factor  included  as  an  adjustment  factor  on  pricing  data 

■  Boeing  was  the  winner 

■  Observations 

■  Direct  competition  between  near-substitutes  presents  challenges 

■  Effectiveness  analyses  can  frame  choice  between  near-substitutes 


Sole-source  lease  prices  will  likely  be  improved  upon 
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Conclusions 


■  Observations  on  case  studies 

■  Near-substitutes  can  provide  options  to  fill  capability  gaps,  and  thus 
competitive  pressure 

■  Up-front  investment  for  competition  is  relatively  small 

■  Near-substitutes  can  expand  the  base  of  suppliers 

■  Cost-effectiveness  analysis  can  help  determine  the  relative  value  of 
near-substitutes 

■  However,  AoAs  and  similar  activities  after  Milestone  B  (II)  have 
been  ad  hoc  in  nature 

■  A  formal  “rolling  AoA”  process  could  foster  competition 
between  near-substitutes 

■  If  post-MS  B  material  changes  to  programs  and/or  environment  are 
evident,  a  fresh  cost-effectiveness  analysis  can  bring  viable  near¬ 
substitutes  to  the  fore. 
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